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•  AFFTC  Mission 

•  Test  Approaches 

•  AFFTC  Application  Examples 

•  AFFTC  Way  Forward 

•  Potential  Research  Areas 
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AFFTC  Mission 
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The  Air  Force’s  center  of  excellence  for  airframel 
propulsion,  avionics  and  electronic  warfare 
research  developmental  test  &  evaluation 

Leverage  our  location,  weather,  partnerships  & 
personnel  to  conduct  independent,  objective 
assessments  on  behalf  of  the  United  States  Air 
Force 
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Test  Approaches 
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AFFTC 


•  Statistical 

-  Designed  Experiments 

-  Observational  Studies  (may  have  limited  scope  of 
inference  based  on  test  design) 

•  Demonstrations 

•  SME/Opinion-Based 


•  Primary  difference  is  in  the  outcome  of  each 
approach: 

•  Validity  of  the  result,  and 

*  Scope  of  inference  that  can  be  made  for  that  test 


AFFTC  Application: 

Target  Detection  and  Recognition 


mw 


Test  Objective: 

•  Demonstrate  the  ranges  at  which  a  pilot 
can  recognize  and  identify  certain  ground 
targets  using  imaging  sensors  in  a 
targeting  pod 

Test  Approach: 

•  DOE  with  four  factors  and  four  response 
variables 

•  Augmented  flight  tests  with  post-flight 
video  review 


Analysis  Approach: 


Paired  t-test  to  compare  in-flight  data  to 
post-flight  data 

ANOVA  to  determine  significant  factors, 
recognition  ranges,  and  identification 
ranges 


No  statistical  difference,  but  close! 


Results: 


Variance  Components 


Recognition  Range 


Target'lmage  Processing;  Weighted  Means 
Vertical  bars  denote  0.95  confidence  intervals 
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AFFTC  Application: 

Endurance  Verification 
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Test  Objective: 

•  Determine  if  an  aircraft,  in  mission 
capable  configuration,  has  a  minimum 
total  endurance  of  X  hours  plus 
appropriate  fuel  reserves  IAW  AF 
instructions 


Test  Approach: 

•  Collect  flight  data  regarding  drag  and  lift 
coefficients,  fuel  flow,  and  static  pressure 
error 


Analysis  Approach: 

•  Estimate  uncertainties  associated  with 
weight,  outside  air  temperature,  thrust, 
fuel,  flow,  drag  coefficient,  and 
calibrated  airspeed 

•  Use  Monte-Carlo  analysis  to  generate 
expected  range  and  endurance 


Results: 


Histogram  with  Normal  Distribution  Curve  for  912  Runs 
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AFFTC  Way  Forward 
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•  Developing  handbook  to  include  overview  of 
statistics  and  AFFTC  best  practices 

•  Adding  statistics  input  and  review  to  our  test 
planning  and  reporting  processes 

•  Working  potential  research  projects  with  Air 
Force  Institute  of  Technology  and  USAF  Test 
Pilot  School 

•  Planning  pathfinder  projects  in  each  flight  test 
technical  discipline 


Flight  controls 
Collision  avoidance 
Performance 

Human  Systems  Integration 
Radar  Systems 
Electronic  Attack 


Modeling  &  Simulation 
Guidance,  Nav,  ID 
Communications 
C4ISR 


R&M 

Avionics 

Threat  Signals 

Propulsion 

Structures 

Subsystems 


Weapons  Systems 
Anechoic  Facility 
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Potential  Research  Topics 

^ :  Aim 

•  Flight  test  techniques  that  take  advantage  of 
advanced  computing  &  statistical  methods 

•  Analysis  of  time  series  data 

-  Tends  to  be  highly  correlated 

-  Often  violates  independence  assumptions  required  for 
analyzing  normal  data 

•  Quantifying  aleatory  and  epistemic 
measurement  uncertainties  associated  with: 

-  Digital  data  buses 

-  Data  models 

•  Bayesian  techniques 

-  Combining  prior  information  with  flight  test  data 

-  Combining  multiple  models 
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